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Atty. Docket No. LECOl P-428 
Express Mail No. EL703563455US 

INDENTATION HARDNESS TEST SYSTEM 
[0001] This application claims the benefit of United States Provisional Patent Application 

Serial No. 60/419,475, entitled "MICRO HARDNESS TEST SYSTEM," which was filed 
October 18, 2002, and which is hereby incorporated herein by reference in its entirety. 
[0002] A portion of the disclosure of this patent document contains material, which is subject 

to copyright protection. The copyright owner has no objection to the facsimile reproduction by 
anyone of the patent document or the patent disclosure, as it appears in the Patent and 
Trademark Office patent file or records, but otherwise reserves all copyright rights 
whatsoever. 



REFERENCE TO COMPUTER PROGRAM LISTING APPENDIX 

[0003] A computer program listing appendix on one compact disc (labeled "Computer 

Program Listing Appendix-Disc 1/Copy 1") includes the following files: 



File Name 


Creation Date 


Size (bytes) 


BasicDrawing.cpp 


October 1, 


2003 


1,766 


BasicDrawing.h 


October 1, 


2003 


1,310 


BasicHandle.cpp 


October 1, 


2003 


5,194 


BasicHandle.h 


October 1, 


2003 


3,005 


BasicNavigationPoint.cpp 


October 1, 


2003 


2,077 


BasicNavigationPoint.h 


October 1, 


2003 


1,260 


Compositelmage . cpp 


October 1, 


2003 


23,476 


Compositelmage . h 


October 1, 


2003 


1,935 


Compositelmaging . h 


October 1, 


2003 


714 


CompositeLiveO verlay . cpp 


October 1, 


2003 


8,958 


CompositeLiveOverlay.h 


October 1, 


2003 


1,590 


CompositeStageMediator.cpp 


October 1, 


2003 


5,174 


Compos iteStageMediator . h 


October 1, 


2003 


982 


CompositeViewLayer.cpp 


October 1, 


2003 


6,467 


CompositeViewLayer.h 


October 1, 


2003 


1,502 


Drawable.h 


October 1, 


2003 


392 


Drawing. h 


October 1, 


2003 


2,152 


DrawingTool.cpp 


October 1, 


2003 


1,390 


DrawingTool.h 


October 1, 


2003 


2,255 


Drawing View, h 


October 1, 


2003 


1,141 


Figure.cpp 


October 1, 


2003 


935 



Figure.h 


October 1, 2003 


4,153 


FigureBasexpp 


October 1, 2003 


3,595 


FigureBase.h 


October 1, 2003 


1,729 


Geometry, cpp 


October 2, 2003 


11,490 


Geometry .h 


October 1, 2003 


6,242 


Grabber, cpp 


October 1, 2003 


14,952 


Grabber, h 


October 1, 2003 


2,950 


GrabberProvider . h 


October 1, 2003 


1,184 


GraphicPrimitives . cpp 


October 2, 2003 


9,612 


GraphicPrimitives.h 


October 1, 2003 


4,085 


laDoc.cpp 


October 1, 2003 


23,986 


laDoc.h 


October 1, 2003 


6,228 


Image, h 


June 10, 2003 


3,201 


ImageOverlay.h 


June 10, 2003 


1,916 


Indent, cpp 


October 1, 2003 


49,537 


Indent, h 


October 1, 2003 


10,349 


IndentDrawing . cpp 


October 1, 2003 


40,163 


IndentDrawing.h 


October 1, 2003 


7,182 


IndentGroup.cpp 


October 1, 2003 


49,011 


IndentGroup.h 


October 1, 2003 


9,937 


IndentPosLine . cpp 


October 1, 2003 


14,448 


IndentPosLine.h 


October 1, 2003 


3,325 


IndentVector . cpp 


October 1, 2003 


19,455 


IndentVector.h 


October 1, 2003 


4,190 


InlmageSource . cpp 


October 1, 2003 


10,883 


InlmageSource.h 


October 1, 2003 


1,806 


Movelnfolmpl . cpp 


October 1, 2003 


1,807 


Movelnfolmpl.h 


October 1, 2003 


1,203 


MtCamera.h 


October 1, 2003 


1,578 


MtStage.cpp 


October 1, 2003 


54,322 


MtStage.h 


October 1, 2003 


15,851 


MtStageCom.cpp 


October 1, 2003 


13,620 


MtStageCom.h 


October 1, 2003 


2,094 


MtTrace.cpp 


July 22, 2003 . 


21,219 


MtTrace.h 


June 10, 2003 


3,314 


NavigationPoint. h 


October 1, 2003 


1,818 


Objective, cpp 


June 10, 2003 


7,464 


Objective. h 


June 10, 2003 


2,481 


PanopticSettings.h 


October 1, 2003 


713 


PanopticView . cpp 


October 1, 2003 


43,831 


PanopticView.h 


October 1, 2003 


5,994 


PatternPreferences . cpp 


October 1, 2003 


3,542 


PatternPref erences . h 


October 1, 2003 


2,946 



»• t 



PositionTool.cpp 

IT IT 


October 1, 2003 


10,992 


PositionTool.h 


October 1, 2003 


1,465 


TextFigure.cpp 


October 2, 2003 


6,380 


TextFigure.h 


October 2, 2003 


2,929 


TransformationMatrixZD . cpp 


October 1, 2003 


3,771 


TransformationMatrix2D.h 


October 1, 2003 


1,915 


ViewLayer.h 


October 1, 2003 


565 



and an identical copy (labeled "Computer Program Listing Appendix-Disc 1/Copy 2") of the 
compact disc (labeled "Computer Program Listing Appendix-Disc 1/Copy 1") are attached 
hereto. The files included on Disc 1/Copy 1 on CD-R are in ASCII file format. The above- 
referenced computer program listing provided on the compact disc labeled "Computer Program 
Listing Appendix— Disc 1/Copy 1" is hereby incorporated herein by reference in its entirety. 

BACKGROUND OF THE INVENTION 

[0004] The present invention is generally directed to a test system and, more specifically, to an 

indentation hardness test system. 

[0005] Hardness testing has been found to be useful for material evaluation and quality control 

of manufacturing processes and research and development endeavors. The hardness of an 
object, although empirical in nature, can be correlated to tensile strength for many metals and 
provides an indicator of wear-resistance and ductility of a material. A typical indentation 
hardness tester utilizes a calibrated machine to force a diamond indenter (of a desired 
geometry) into the surface of a material being evaluated. The indentation dimension 
(dimensions) is (are) then measured with a light microscope after load removal. A 
determination of the hardness of the material under test may then be obtained by dividing the 
force applied to the indenter by the projected area of the permanent impression made by the 
indenter, 

[0006] In a typical situation, an operator of an indentation hardness tester is required to 

position indents into a part at precise distances from various part geometries. With reference 
to Figs. 2 and 3, an operator may be required to place a series of five evenly spaced indents 
302 into a surface of a tooth 102A of a portion of, for example, a gear 102 being tested and 
mounted within a plastic 104 to form a test assembly 22. The indents 302 may be spaced 200 
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microns (±5 microns) from each other and centered in a face of the tooth 102 A. Assuming 
that the tooth 102A is approximately 0.5 cm wide by 0.5 cm tall and the tester has two 
magnifications, i.e., a high power 50x objective with a field of view 200 microns wide and a 
5x magnification with a field of view 2000 microns wide, and assuming that an image of the 
tooth 102 A is displayed on a display having a width of 640 pixels, the width of each pixel is 
about 0.3 microns at 50x and about 3.0 microns at 5x magnification. 

[0007] In such a tester, a 5x magnification only allows an operator to see about 1/5* of the top 

surface of a tooth and a 50x magnification only allows the operator to see about 1/50* of the 
top surface of a tooth. It should be appreciated that such a view does not allow an operator to 
precisely know if a stage that is used to position the test assembly 22 is positioned in the center 
of the top surface of the tooth. Thus, to ensure that indentations are perpendicular to the top of 
the tooth 102A and a specified distance from the top surface of the tooth 102A, traditional 
software packages have allowed an operator to position a "T" bar along a displayed image. In 
this manner, an operator would position the top portion of the "T" bar along the top edge of 
the tooth 102A through a combination of moving the stage and rotating the "T" bar. As 
briefly described above, at 5x magnification the operator has a relatively good idea of the 
required orientation of the "T" bar, but not enough resolution to position it within 5 microns 
of the edge. Further, at 50x magnification, locating the top edge of the tooth within 5 microns 
is possible, but the orientation is difficult because the edge is not straight at this magnification. 

[0008] What is needed is a technique that more readily allows an operator of an indentation 

hardness tester to properly position an indenter with respect to a test assembly. 

SUMMARY OF THE INVENTION 
[0009] The present invention is generally directed to an indentation hardness test system that 

includes a frame having a movable turret, a movable stage for receiving a part, a camera, a 
display, a processor and a memory subsystem. The turret includes a first objective lens of a 
microscope and an indenter and the movable stage is configured for receiving a part to be 
tested. The camera captures images of the part through the microscope, which can then be 
provided on the display. The processor is electrically coupled to the turret, the movable stage. 
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the camera and the display, as well as the memory subsystem. The memory subsystem stores 
code that, when executed, instructs the processor to perform a number of steps. That is, the 
code instructs the processor to capture and store a series of real-time images of the part using 
the camera. The code also instructs the processor to store stage coordinates, associated with 
each of the images, and to display a composite image of the part, which includes the series of 
real-time images assembled according to the associated stage coordinates, on the display. 

[0010] According to another embodiment of the present invention, the images are stored at a 

lower resolution than the captured images. According to still another embodiment of the 
present invention, the code instructs the processor to perform the additional step of displaying 
a background pattern in the composite image for the portions of the part that have not been 
captured. According to yet another embodiment of the present invention, the code instructs the 
processor to perform the additional step of normalizing the series of real-time images when at 
least one of the images was captured by a second objective lens, with a different focal length 
than the first objective lens, before displaying the composite image of the part. 

[0011] In another embodiment, the code instructs the processor to perform the additional step 

of displaying an outline of the part in a composite image. The step of displaying an outline of 

the part in the composite image may also include the steps of: examining a frame of an image 

stream of the part to locate an edge of the part and moving the part in a direction parallel to. the 

edge of the part such that the edge remains in the field of view for a next firame until the 

» 

outline of the part is complete. The code may also cause the processor to perform the 
additional steps of overlaying a current position image of the part in the composite image and 
indicating a location of the current positioned image. Further, the code may allow the 
processor to perform the additional steps of overlaying an indent position diagram on the 
composite image and displaying a proposed indent location within an indentation outline that 
represents a geometry and size (based upon an expected indenter), an expected orientation of 
the indenter, an expected indenter load and an expected hardness of the part. 
[0012] These and other features, advantages and objects of the present invention will be further 

understood and appreciated by those skilled in the art by reference to the following 
specification, claims and appended drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] In the drawings : 

[0014] Fig. 1 is a perspective view of an exemplary indentation hardness tester, according to 

one embodiment of the present invention; 
[0015] Fig. lA is an electrical block diagram of an exemplary indentation hardness test system 

configured according to one embodiment of the present invention; 
[0016] Fig. 2 is a perspective view of a test assembly that includes a portion of a gear mounted 

in a plastic; 

[0017] Fig. 3 is an enlarged fragmentary top plan view of a portion of a tooth of the gear of 

Fig. 2 showing desired indent positions; 
[0018] Fig. 4A is a view of a portion of the tooth of the gear of Fig. 2 at 50x magnification, 

displayed on a monitor of a prior art indentation hardness test system; 
[0019] Fig. 4B is a view of a different portion of the tooth of the gear of Fig. 2 at 5x 

magnification, displayed on a monitor of a prior art indentation hardness test system; 
[0020] Fig. 5 is a view of a composite image, including the 50x and 5x magnification areas of 

Figs. 4 A and 4B, respectively, displayed on a monitor of an indentation hardness test system 

configured according to one embodiment of the present invention; 
[0021] Fig. 6 is an exemplary data structure diagram used to determine individual image 

locations in a composite image of a part; 
[0022] Fig. 7 is a flow chart of a routine for creating a composite image of a part; and 

[0023] Figs. 8A-8G are exemplary displays provided by an indentation test system according 

to one embodiment of the present invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
[0024] A system according to various embodiments of the present invention can be 

implemented using an indentation hardness tester that includes: a light microscope, a digital 
camera positioned to collect images through the microscope, an electrically controlled stage 
capable of moving a test assembly, i.e., an associated part to be tested or a portion of a part 



mounted in a plastic, in at least two dimensions in a plane perpendicular to the lens of the light 
microscope, and a processor (or computer system) connected to both the camera and the stage 
such that the processor can display images acquired by the camera while monitoring and 
controlling the movements of the stage and its associated part. 

[0025] Fig. 1 shows a partial perspective view of an exemplary indentation hardness tester 

according to one embodiment of the present invention. The indentation hardness test system 
10 includes a frame 20 with an attached motorized turret 14, including objective lenses 16A 
and 16B, which form a portion of a light microscope, and an indenter 18, e.g., a Knoop or 
Vickers indenter. It should be appreciated that additional objective lenses may be mounted on 
the turret 14, if desired. A stage 12 is movably attached to the frame 20 such that different 
areas of a test assembly 22, which is attached to the stage 12, may be inspected. 

[0026] Fig. lA depicts an exemplary electrical block diagram of various electrical components 

that may be included within the definition of the test system 10. As is shown, a processor .40 
is coupled to a memory subsystem 42, an input device 44 (e.g., a joystick, a knob, a mouse 
and/or a keyboard) and a display 46. A frame grabber 48, which is coupled between the 
processor 40 and a camera 52, functions to capture frames of digital data provided by the 
camera 52. The camera 52 may, for example, provide an RS-170 video signal to the frame 
grabber 48 that is digitized at a rate of 30 Hz. The processor 40 is also coupled to and 
controls a turret motor 54 to properly and selectively position the objective lenses 16A and 16B 
and the indenter 18 (e.g., a diamond tipped device), as desired. It should be appreciated that 
additional indenters may also be located on the turret 14, if desired. The processor 40 is also 
coupled to stage motors (e.g., three stage motors that move the stage in three dimensions) 56 
and provides commands to the stage motors 56 to cause the stage to be moved, in two or three 
dimensions for image capture and focusing, as desired. The stage motors 56 also provide 
position coordinates of the stage that are, as is ftirther discussed below, correlated with the 
images provided by the camera 52. The position coordinates of the stage may be provided by, 
for example, encoders associated with each of the stage motors 56, and may, for example, be 
provided to the processor 40 at a rate of about 30 Hz via an RS-232 interface. Alternatively, 
the processor 40 may communicate with a separate stage controller that also includes its own 
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input device, e.g., a joystick. The processor 40, the memory subsystem 42, the input device 
44 and die display 46 may be incorporated within a personal computer (PC). In this case, the 
frame grabber 48 takes the form of a card that plugs into a motherboard associated with the 
processor 40. As used herein, the term processor may include a general purpose processor, a 
microcontroller (i.e., an execution unit with memory, etc., integrated within a single integrated 
circuit), an application specific integrated circuit (ASIC), a programmable logic device (PLD) 
or a digital signal processor (DSP). 

[0027] With reference again to Fig. 2, the test assembly 22 includes a part to be tested, i.e., a 

portion of a gear 102, that is mounted in the material 104, e.g., a phenolic resin, for testing. 
With reference to Fig. 3, the tooth 102A of the gear 102 may typically have a face with 
dimensions of about 0.5 cm by 0.5 cm in which indentations are to be placed in a desired 
indentation pattern. As is shown in Fig. 3, five evenly spaced indents 302 are depicted. In a 
typical situation, a part that is to be subjected to indentation hardness testing is often measured 
in centimeters, while the dimensions of the indentations typically range from 10 to 100 
microns. A typical field of view for a light microscope may range from 100 microns to 5000 
microns. As previously discussed, and with reference to Figs. 4B and 4A, respectively, a 
traditional indentation hardness tester with objective lenses of 5x and 50x allows an operator of 
the system to see about 1/5* of the top portion of a typical tooth at the 5x magnification and 
only about 1/50* of the top surface of the tooth at the 50x magnification. As mentioned above, 
it is often difficult for the operator to know if the stage is positioned in the center of the face of 
the tooth when the magnification is set at 50x. According to the present invention and as is 
shown in Fig. 5, a composite image 500 provides a wider field of view to allow the operator to 
more precisely determine where the indents are to be positioned on the tooth. 

[0028] According to one embodiment of the present invention, the processor 40 collects a 

series of real-time images and stage coordinates as an operator manually traverses the part. In 
doing so, the processor 40 executes a routine that assembles the data into, i.e., renders, a 
composite (or panoptic) image that shows the portions of the part that have passed under an 
objective lens of the microscope, whose objective lens is mounted to the turret of the test 
system. It should be appreciated that irrespective of the magnification of the image provided, a 
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composite image may be stored at a lower resolution, e.g., a resolution of approximately 5 
. microns per pixel, if memory limitations are of concern. 

[0029] With reference to Fig. 6, a data structure diagram 600 is depicted, which is utilized to 

associate data with a composite image. As can be seen, from review of Fig. 6, the exemplary 
storage mechanism is based on a tree design. To correlate images from the camera 52, the 
processor 40 stores images in a time-stamped image queue, e.g., a first-in first-out (FIFO) 
buffer, and stage positions are recorded in a time-stamped position queue, e.g., another first-in 
first-out (FIFO) buffer, located in the memory subsystem 46. For each given image in the 
queue, a routine is implemented that searches for a stage position and velocity information for 
the period surrounding the time that the image was acquired. Then, using interpolation, the 
processor 40 accurately determines where the stage 12 was when the image was acquired. 
This technique allows for accurate positioning of a given image in the composite image. 
Further, as the direction and velocity of the part is known when a given one of images is taken, 
Fast Fourier Transform (FFT) techniques, or other image processing techniques, may be 
utilized to de-blur the image. 

[0030] With reference to Fig. 7, a routine 700 is depicted that records the quality of the data of 

a given image, based on the objective lens 16A or 16B selected and the stage 12 velocity. In 
this manner, new image data only replaces old image data when an operator retraces a portion 
of the part if the calculated quality is not significantly worse. In step 702, the routine 700 is 
initiated, at which point control transfers to step 702. Next, in step 704, the processor 40 
receives stage positions from the stage motors 56 and time-stamped unages from the camera 
52, via the frame grabber 48. Next, in step 706, the processor 40 interpolates the stage 
positions to determine the location of the stage when the image was captured. The acquired 
images are then processed using various techniques, e.g., de-interlacing, de-blurring, shade 
correction and stretching/shrinking. After processing the image, in step 708, the processor 40 
determines whether the quality (as determined by, for example, stage velocity and a current 
objective lens) of a particular image has improved in decision step 710. If the quality of the 
image has improved, control transfers to step 711, where the old image is replaced with a new 



image. Otherwise, control transfers from step 710 to step 712, where the processor 40 retains 
the old image and utilizes it in the display of the composite image on the display 46. 

[0031] A composite image created according to the present invention is well suited for high- 

speed modification and retrieval while using a minimal amount of computer memory, in 
comparison to that required for a single large dimension image. This is achieved by storing 
the composite image in a series of discrete sized two-dimensional tiles, organized in a binary 
tree by stage position (see Fig. 6). Next, in decision step 714, the processor 40 determines 
whether the operator has completed the image gathering process. If so, control transfers to 
step 716, where the routine 700 terminates. Otherwise, control transfers to step 704, where 
the processor 40 continues to receive and store stage positions and time-stamped images. 

[0032] According to one embodiment of the present invention, portions of the part that have 

not been explored are indicated in a contrasting color or pattern, e.g., a lightly shaded non- 
gray color, with the position of the lens, i.e., a current live view, embedded in the composite 
image and positioned with respect to its current position on the part. The live view may be 
indicated by, for example, a thin-lined rectangle overlaid on the composite image. According 
to another embodiment of the present invention, in order to speed up the capturing of the 
image of the part, a routine is provided that allows automatic traversal of the contours of the 
entire part during the image capture process. 

[00331 According to the present invention, as the operator zooms in on any portion of the 

composite image, the stage is automatically moved to that location and a live view is embedded 
in the composite image. In one embodiment, when the objective is set at 50x magnification, 
the resolution of the live view inside the thin-lined rectangle is about 0.3 microns per pixel and 
outside of the rectangle the resolution is about 5 microns per pixel. As mentioned above, the 
system may be advantageously configured such that an operator may manually move the stage 
with a joystick or other input device. When the system is set up such that a routine is 
controlling the movement of the stage, the movement of the stage may be indicated in multiple 
ways. For example, a live view may be fixed, allowing the part to move past the objective 
lens or, alternatively, the composite image may be fixed and a location of the live view may 
move. 
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[0034] As previously discussed, traditional indentation hardness test systems have allowed an 

operator to position a "T" bar along a surface of the part to be tested to ensure that the 
indentations are perpendicular to the top surface of the gear tooth and at a specified distance 
from the top surface. However, as previously discussed, at 5x magnification the operator has a 
relatively good idea of the required orientation of the "T" bar, but not enough resolution to 
position it within 5 microns of the edge. Further, at 50x magnification, locating the edge 
within 5 microns is possible but the orientation of the "T" bar is difficult because the edge is 
not straight at this magnification level. One solution to this problem is to rotate the "T" bar at 
5x magnification and position it on the edge at 50x magnification. Another solution that yields 
a more accurate rotation angle involves allowing the "T" bar to be larger than the field of view 
for any objective and uses a composite image to accurately position the "T" bar. As 
previously mentioned, this allows an operator to zoom in on any location of the part and a live 
view of that portion of the part may be provided at a required resolution. 

[0035] Traditional indentation hardness test systems have displayed a pattern of desired indents 

in a separate window. In these systems, an operator has manipulated the indent locations in 
the pattern window and then instructed the system to make the indents in the part. However, 
as previously discussed, it is difficult for an operator to correlate the proposed indent locations 
in a pattern window with the exact position on the part as seen in a live view. 
Advantageously, embodiments of the present invention allow a pattern window to be overlaid 
on top of a composite image. Thus, an operator may position indents with respect to large 
scale features of the part and with respect to the low resolution composite image. In this 
manner, an operator can then fine tune the indent locations by zooming in and viewing the 
indent positions through an embedded live view. Further, in a system so configured, screen 
display area is conserved as only one window is required. That is, multiple windows, each 
showing a different layer of data, are not required as a composite image of a part may be 
shown in one window on an indentation test system configured according to the present 
invention. However, it should be appreciated that an indentation test system configured 
according to the present invention may implement multiple windows, each showing the 
composite image and being separately sizeable, zoomable and panable, if desired. According to 
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one embodiment, the present invention allows the conventional "T" bar to be dispensed with 
and replaced with an improved similar "T" shape, whose top is elongated and can easily be 
aligned with the part and whose base consists of the proposed indent locations. However, it 
should be appreciated that shapes, e.g., a line segment and a circle of a known radius, other 
than the "T" shape may be desirable depending upon the application. 
[0036] Fig. 8A shows a display 800 of a composite image of the gear 102 after tracing, i.e., 

capturing images, of an edge 802 of the gear 102. As is shown, the display 800 includes an 
embedded live image 804 with portion of the gear 102 that has not yet been captured denoted 
with a background pattern 806. Fig. 8B shows a display 810, which depicts a magnified view 
of the tooth 102A, which includes the embedded live image 804 and a "T" shape 811 that is 
used to facilitate the placement of indent locations according to the present invention. Fig. 8C 
shows a display 820 that is a ftirther magnified view of the composite unage of the tooth 102A 
shown in the display 810, which also includes the live view 804 and the leg of the "T" shape 
811 that is utilized for positioning indent locations. Figs. 8D-8F show displays 830, 840 and 
850, respectively, illustrating the alignment of the "T" shape with the tooth 102A in order to 
facilitate placement of the indent locations. Fig. 8G depicts a display 860 that illustrates the 
proposed indent locations 813 overlaid on the composite image and a current live image 804 A. 
Embodiments of the present invention advantageously allow the indent locations 813 to be 
manipulated. That is, the indent locations 813 may be added or removed, moved to a new 
location and/or rotated/translated as a group, using an appropriated input device, i.e., mouse, 
keyboard, etc. 

[0037] Accordingly, a number of techniques have been described herein that advantageously 

allow an operator of an indentation hardness test system to readily position indent locations in 
a part that is to be hardness tested. 

[0038] The above description is considered that of the preferred embodiments only. 

Modifications of the invention will occur to those skilled in the art and to those who make or 
use the invention. Therefore, it is understood that the embodiments shown in the drawings and 
described above are merely for illustrative purposes and not intended to limit the scope of the 
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invention, which is defined by the following claims as interpreted according to the principles of 
patent law, including the doctrine of equivalents. 
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